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AN ADAPTIVE PROCESS FOR REMOVING STREAKS IN MULTI- 



BAND DIGITAL IMAGES 



FIELD OF THE INVENTION 

The invention relates generally to the field of image processing, 
and in particular to an image processing method for removing streaks in multi- 
band digital images (images consisting of three or more spectral bands). The 
invention is particularly useful in removing streaking in multi-band digital images 
that are acquired by a linear image sensing array, but may also be used to remove 
streaks in conventional color film that are caused by the camera or processing 
equipment. 

BACKGROUND OF THE INVENTION 

Multi-band imaging sensors typically are designed such that each 
band of the imaging system is sensitive to a pass-band of electromagnetic 
radiation. For example, a standard color imaging system consists of three bands 
(or arrays of detectors) sensitive to red, green, and blue light, respectively. 
Imaging systems such as multi-spectral or hyper-spectral systems contain many 
detector bands. These systems may contain spectral bands sensitive to non-visible 
parts of the electromagnetic spectrum such as to NIR (near-infrared), SWIR 
(short-wave infrared) or MWIR (mid-wave infrared) in addition to bands sensitive 
to red, green, and blue light. Color composite imagery is coihmonly formed from 
multi-spectral imagery and hyper-spectral imagery by mapping three selected 
bands to the red, green, and blue bands of an output display device such as a video 
monitor, or a digital color printer. 

Every detector of a given spectral band in an electronic image 
sensor, such as a CCD image sensor, may have a different response function that 
relates the input intensity of light (or other electromagnetic radiation) to a pixel 
value in the digital image. This response function can change with time or 
operating temperature. Image sensors are calibrated such that each detector in a 
given spectral band, has the same response for the same input intensity 



(illumination radiance). The calibration is generally performed by illuminating 
each detector of the spectral band with a given radiance from a calibration lamp 
and then recording the signal from each detector to estimate the response fimction 
of the detector. The response function for each detector is used to equalize the 
output of all of the detectors such that a uniform illxmiination across all of the 
detectors will produce a uniform output. This calibration is typically performed 
separately for each band of a multi-band imaging system. 

FIG. 1 shows a schematic of an image acquired by a linear image 
sensing arrays. In such an image, if errors in estimating the response curve of a 
detector are different from the errors in the response curve of an adjacent detector, 
the detector responses will not be equalized and streaking 2 will appear in the 
image along the scan direction indicated by arrow A. Since these calibration 
errors can occur within each band of a spectral imaging system, and several bands 
of a spectral imaging system are often combined together to form a color 
composite image, the streaking 2 may appear in various colors. Often to achieve a 
very long array, several image sensor chips are joined together to form a single 
linear image sensor. Slight differences in response between chips (due to 
variations in sensor chip manufacturing, or sensor electronics processing) can lead 
to large calibration errors between chips. When calibration errors occur between 
chips, the streaking is generally referred to as banding, as illustrated at reference 
numeral 4. 

Even when the detectors are calibrated to minimize the streaking in 
the image, some errors from the calibration process are unavoidable. Typically, a 
spectral filter is placed on a given detector, or sensor chip to create an imaging 
band sensitive to a specific region in the electromagnetic spectrum. Depending on 
the architecture of the sensor array, it may be necessary to have several spectral 
filters of the same bandpass to cover the entire array. Often, due to the variations 
in the spectral filter manufacturing process, the filters that are placed over the 
detectors in a given band may be slightly different in spectral bandpass and 
spectral shape. In addition, material variations, and the angle of incidence of light 



on a spectral filter, causes additional spectral variations depending on the position 
of the spectral filter on the sensor array. As a result, each detector within a 
spectral band is sensitive to a slightly different spectrum of light, but they are all 
calibrated using the same calibration lamp with a broad, non-uniform spectrum. 
Since the scene spectrum is unknown, the calibration process assumes that the 
spectrum of the calibration lamp and scene are identical. The spectrum of the 
calibration lamp will usually be somewhat different than the spectrum of the scene 
being imaged, hence calibration errors will occur. This calibration error is also 
referred to as spectral banding. Calibration errors also occur because the 
calibration process includes an incomplete model of the complete optical process 
and because the response function for each detector changes over time and 
operating temperature. 

Streaking can be seen in uniform areas of an image acquired by a 
linear detector and become very apparent when the contrast of the image is 
enhanced. Calibration differences between the red, green, and blue detectors of 
color imaging systems (or any of the bands in a multi-spectral or hyper-spectral 
imaging system) produce streaks of varying colors in the composite color image. 
These streaks not only reduce the aesthetic quaHty of digital images but can 
impact the interpretability of features in the images. Streaking also severely 
degrades the performance of pattern recognition, feature extraction algorithms, 
image classification algorithms and automated or semi-automated target 
recognition algorithms. 

Streaks can be attenuated by reducing the contrast of each image 
band or by blurring each image band in a direction perpendicular to the streaking, 
but these methods degrade the quality of the overall image. Previously developed 
algorithms designed to remove streaks from digital imagery while preserving the 
sharpness and contrast of the image were designed to remove streaks on single 
band imagery; not on multi-band imagery. These algorithms only take into 
accoimt spatial information present in the image to remove streaks. No attempt is 
made to examine additional color information or spectral correlation available in 



multi-spectral or hyper-spectral imagery to remove streaks. As a result, when 
applying these techniques to multi-band imagery, these algorithms do not 
completely remove all of the color streaks present in the original image and may 
introduce objectionable color streaks or bands as artifacts. These algorithms do 
not preserve and/or restore the overall color fidelity of the image. In addition, 
applying algorithms designed to remove streaks fi-om single band imagery on 
color or multi-spectral imagery, is a non-optimal method for streak removal for 
color imagery or multi-spectral imagery, as these algorithms do not use all of the 
available information that is present in multi-band imagery during the streak 
removal process. 

U.S. Patent No. 5,065,444, issued Nov. 12, 1991, to Garber 
discloses a method of removing streaks fi-om single band digital images by 
assvuning that pixels in a predetermined region are strongly correlated, examining 
the pixels in the region, computing the difference between the pixels in the region, 
thresholding the pixel differences lower than a predetermined value, computing a 
gain and offset value fi-om the distribution of differences, and using the gain and 
offset value to remove the streaking. Methods that assume a strong correlation 
between pixels that are near each other, such as the one disclosed by Garber will 
interpret scene variations as streaks and produce additional streaking artifacts in 
the image as a result of attempting to remove existing streaks. FIG. 2a shows an 
image having streaks 2 and linear features 6 that are in the same direction as the 
streaks. As shown in FIG. 2b, the correction of the streaks 2 using the method 
taught by Garber removes the streaks 2, but results in additional streaking artifacts 
8. Applying the method by Garber to each spectral band of multi-band images 
will result in objectionable color streaks and color banding artifacts. 

U.S. Patent No. 5,881,182, issued March 9, 1999, to Fiete et al., 
which is incorporated herein by reference, discloses a method of removing streaks 
by comparing the means between a local window region of two columns of data in 
the imagery to determine if a streak was present, and presenting statistical 
methods to calculate a gain and offset to remove the streaks. To apply this method 



on spectral or color imagery (imagery that consists of more than one spectral 
band), this method would be applied independently to each band of the spectral 
imagery, and then the bands of the spectral imagery are recombined to form a 
color composite image. The method of Fiete et al. looks only at the spatial and 
luminance information within each band independently; hence calibration 
differences between each of the bands may not be corrected. As a result, when 
applied independently to each band of a multi-band image, and then combining 
these spectral bands together to form a color composite image, all of the color 
streaks may not be completely removed from the imagery. Yet, when the three 
spectral bands from a multi-band spectral image, each containing some 
unremoved streaks and slight banding artifacts, are combined to form a composite 
three band color image, these artifacts manifest to form objectionable color streaks 
and color banding in the color composite imagery. The method of Fiete et al. does 
not adequately remove color streaks from multi-band imagery. 

There is a need therefore for an improved digital image processing 
method for removing streaks in color or multi-band images. The method 
presented here is an improvement of the method of Fiete et. al. to better remove 
color streaks and bands from multi-band imagery. 

SUMMARY OF THE INVENTION 

The object of the present invention is achieved in a method of 
removing columnar streaks from a multi-band digital image of the type in which 
the spectral bands are transformed to an advantageous spectral space, the streak 
removal operation is performed in the advantageous spectral space, and then the 
bands are transformed back into the original space. The method of removing 
columnar streaks is a method of the type in which it is assumed that pixels in a 
predetermined region near a given pixel within each transformed band are strongly 
related to each other and employing gain and offset values to compute streak 
removal information, by testing for a strong relation between the pixels in a 
predetermined region near a given pixel and computing streak removal 



information only if such a strong relationship exists, whereby image content that 
does not extend the full length of the image in the colimmar direction will not be 
interpreted as a streak. 

The method of the present invention adaptively removes streaking, 
as well as banding, in multi-band digital images without reducing the sharpness, 
contrast, or color fidelity of the image. Streaking occurs in multi-band image 
output fi-om linear scanners and is generally caused by differences in the 
responsivity of detectors or amplifiers or non-uniform spectral response of filters. 
The method disclosed detects pixel locations in the image where pixel-to-pixel 
differences (both within bands and between bands) caused by streaking can be 
distinguished fi-om normal variations in the scene data. A linear regression is 
performed between each spatially and spectrally adjacent pixel in a direction 
perpendicular to the streaking at the detected locations. A statistical outlier 
analysis is performed on the predicted values to remove the pixels that are not 
from the streaking. A second linear regression is performed to calculate the slope 
and offset values. The slope is set to unity if it is not statistically different from 
unity, and the offset is set to zero if it is not statistically different from zero. The 
slope and offset values are then used to remove the streaking from the 
corresponding line of image data. 

ADVANTAGEOUS EFFECT OF THE INVENTION 

This invention adaptively removes streaking in multi-band digital 
image by using both spatial and spectral information within the image. By using 
spectral information present in multi-band imagery, better determinations can be 
made of streaks than by using just spatial information present in just one band of 
the imagery. 

The streak removal operation consists of transforming the multi- 
band data to an advantageous spectral space, testing for a strong correlation 
between the pixels in a predetermined region and computing streak removal 
information only if such a strong relationship exists, and the transforming back 



into the original spectral space. This process will remove the residual streaks that 
appear even after a calibration is performed on the imaging sensor. This method 
does not reduce the contrast, sharpness, and preserves and / or improves the color 
fidelity of the image. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 illustrates the streaking artifact in an image; 

FIG. 2(a) - 2(b) illustrates the artifacts produced by methods that 
assume that pixels in a predetermined region near a given pixel are strongly 
related to each other; 

FIG. 3 is a diagram showing an image processing chain using the 
present invention; 

FIG. 4 illustrates the individual spectral bands that make up a 
multi-band image; 

FIG. 5, made up of FIG. 5(a) and FIG. 5(b), is a flow chart of the 
entire multi-band streak removal process according to the present invention 

FIG. 6 illustrates a digital mask that is used to test for pixels that 
are strongly related to each other in a predetermined region; and 

FIG. 7 is a graph illustrating the line£ir regression with the two 
adjacent columns of image data, useful in describing the method of the present 
invention. 

DETAILED DESCRIPTION OF THE INVENTION 

The streak removal process of the present invention can be 
employed in a typical image processing chain, such as the one shown in FIG. 3. A 
digital sensor 10, e.g. a linear scanner used in a camera system or a photographic 
scanner, outputs a multi-band digital image 12. If the detectors have gone through 
a calibration process, then each band of the multi-band digital image 12 may go 
through a detector equalization process 14 to produce an equalized multi-band 
image 16. Both the digital image 12 and the equalized image 16 will contain 
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streaks 2 as shown in Fig. 1. The digital muhi-band image 12 or the equalized 
digital multi-band image 16 is processed through the multi-band streak removal 
process 1 8 to produce a corrected digital multi-band image 20 that has the streaks 
removed. This corrected digital image 20 is then processed through the nominal 
image processing chain and enhancements 22 to produce the final processed image 
24. Without the streak removal process 18, the image processing and 
enhancements 22 may actually reduce the quality of the final processed image 24, 
especially if the digital image 12 is low in contrast or if the image processing and 
enhancements 22 includes a feature extraction algorithm, or an automated 
computer information extraction algorithm. 

If the original image was a photographic color image having 
streaks or scratches, for example the scratches seen in old movie film, the images 
may be scanned in a high quality scanner and the streaks or scratches removed by 
the method of the present invention. 

The preferred embodiment of the multi-band streak removal 
process described below is presented in the context of removing streaks fi-om a 
multi-band sensor system. A single-band sensor system collects a single image 
that represents a single spectral band of the scene. A multi-band sensor system 
collects a total of Nt^^d multiple images, each acquired at different spectral bands 
denoted (A,,, A,2, . . X-^band)* shown in FIG. 4. If the multi-band sensor 
systems contain more than three spectral bands, then at the completion of the 
spectral band removal operation, any three of the spectral bands may be selected 
to create a color composite image for output display, (i.e. mapped to the red, 
green, and blue channels of an output device) or a subset of the Nband images may 
be selected for input into an automated information extraction algorithm. 

Presented below is the single-band streak removal operation 18. 
For the discussion of this invention it will be assumed that the streaks occur in 
columnar direction of each band of the multi-band digital image 12. The pixel at 
column coordinate x and row coordinate y and band location z has a digital coimt 
value i(x,y,z). If d^ is the detector for column x, then the response curve for 



detector in the digital sensor 10 can be modeled as a linear function of the input 
illumination radiance, thus 

i(x,y,z) = a^ I(x,y,z) + b^, 

where I(x,y,z) is the intensity of the illumination radiance at location (x,y,z) in the 
image, a^ is the gain for detector d^, and b^, is the bias for detector d^. 

Streaks occur in the digital image 12 because adjacent detectors in 
the digital sensor 10 have different response curves. The difference A(x,y,z) 
between adjacent pixels within band z is given by 

A(x,y,z) = i(x,y,z) - i(x+l,y,z) = a^ I(x,y,z) + b^ - a^^, I(x+l,y,z) - b^^„ 

and is dependent on the detector response as well as the difference between the 
illumination radiance incident on the adjacent pixels. If the detectors d, and d^+i 
have the same response curves, i.e. if a^ = a^+, and b^ = b^+,, then 

A(x,y,z) = i(x,y,z) - i(x+l,y,z) = a^ [I(x,y,z) - I(x+l,y,z)], 

and the difference between i(x,y,z) and i(x+l,y,z) is proportional to the difference 
between the illumination radiance incident on the adjacent pixels, which is 
desired, and no streaks due to sensor calibration errors will be present. 
If I(x,y,z) = I(x+l,y,z) in Eq. (2) then 

A(x,y,z) = i(x,y,z) - i(x+l,y,z) = [a^ - a^^,] I(x,y,z) + [b, - b,^,], 

and the difference between i(x,y,z) and i(x+l,y,z) is entirely from the different 
response curves between detectors d^ and d^+,. 

If I(x+l,y,z) is substituted for I(x,y,z) using Eq. (3) then 
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i(x,y,z) = a,-i "-^^ — ^ + = — 5-i(x +l,y,z) + 



a 3- 

If Aa^ ^ — ^ and Ab^ = - — ^ bx+i then 



i(x,y) = Aa^ i(x+l,y,z) + Ab, 

and i(x,y,z) is just a linear transformation of i(x+ly,z) with a slope Aa^ and offset 
Ab^. By determining Aa^ and Ab,, , the streaking between columns x and x+l can 
be removed if the pixel count values i(x-M,y,z) are replaced with 

i(x + l,y,z) where 

i(x + 1, y,z) = Aa^i(x + 1, y,z) + Ab^ . 

The difference between adjacent pixels is now 

A(x, y , z) = i(x, y , z) - 1 (x + 1 , y , z) = a , I(x, y, z) + b , - {Aa , [a I(x + 1 , y, z) + b J + Z 



= a 



J(x,y,z) + b, - j-^[a,,J(x + l,y,z) + b,.J + b, -^b,,,l 



= a^ [l(x, y, z) - I(x + 1 , y , z)] , 



which is the desired result from Eq. (3), hence no streaks due to sensor calibration 
error will be present. 

Methods that determine Aa^ and Ab^ by assuming that the 
illumination radiance is always approximately equal in a predetermined region 
near pixel i(x,y,z), e.g. I(x,y,z) « I(x+l,y,z), such as the one disclosed in U.S. 
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Patent No, 5,065,444, will generate poor estimates of Aa,, and Ab^ where I(x,y,z) ^ 
I(x+l,y,z) and artifacts will occur. Methods that determine Aa^ and Ab^ by testing 
for strong relationships in spatial features within a single band and computing Aa^ 
and Ab^only from pixels where I(x,y,z) ^ I(xH-l,y,z), such as the one disclosed in 
U.S. Patent No. 5,881,122 do not use any available information present in the 
other bands. Spectral streaking will not be removed using these methods. 

According to the present invention, spectral streaks will be 
removed if a spectral transformation is first performed on each imaging band as a 
pre-processing step to transform the data into a spectrally advantageous space. In 
general, the spectral transformation will take the form: 



where 9 is a transformation operator, operating on each of the spectral bands of 
the input image, i(x,y,z). In the preferred embodiment, this transformation is a 
linear combination of the original bands, given by 



where ccz \z the linear transformation coefficients. In matrix notation this 
transform is given by 



where A is the N^and ^ N^j^n^ transformation matrix. The transformation combines 
the radiometric and spectral information from each band into new bands, such that 
when streaks are removed from the transformed data, the spectral information is 
included. The optimal transformation to use will be dependent on the number of 



2=1 



i'(x,y,z') = Ai{x,y,z) 



(11) 
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bands of data, the spectral bandpass of each of the imaging bands, and other 
imaging band dependent sensor characteristics. 

If the multi-band image contains three bands, or three pre-selected 
bands from the multi-band image are desired to form a color composite output, 
5 then the following transformation is used on the data in the preferred embodiment 
to minimize color streaking artifacts: 



o 
SI 



Lji 



V(x,yA) = 0.299i(x,y,l) + 0,587/(x, j;,2) + 0.1 14/(jc,3;,3) (12) 
1 0 f (x, ya) = -0.1 687z(jc, y,l) - 0.33 1 3/(jc, y,2) + 0. 500z(x, y,3) ( 1 3) 

r{x,y,3) = 0,500i(x,y,l) - 0.4187/(x,y,2) - 0.08 13/(x,>',3) . (14) 



Once the spectral transformation is performed, a streak removal 
1 5 operation is performed on each of the spectrally transformed bands of i*(x,y ,z*) 
one band at a time using information from the all other spectral bands in the 
ry streak removal process. Let i'(x,y,Zref) refer to the band cxurently xmdergoing the 

V streak removal operation, where z^^^ is referred to as the reference band. Let 

2 iXx^y^Ztesti) refer to all other bands in the image, excluding the reference bands 

20 (Zref)- These bands shall be referred to as the test bands. In the streak removal 
operation performed on an individual band, a test is performed for a strong 
relationship in spatial features between spectrally and spatially correlated pixels 
and Aa^ and Ab^ are computed only from those pixels where i'(x,y ,Zrec) « 
i*(x+l,y,z„f) and i\x,yyZ^^^^) « i(x+l,y,Zj^f) thus preventing artifacts due to the 
25 processing to remove streaking from occurring and allowing spatial information 
from other bands that are highly correlated to the ciurent band to be used in the 
streak removal process. A schematic of the streak removal process 18 disclosed 
in this invention is shown in FIG. 5. First two adjacent columns of image data are 
selected 30 from band z^f. Next, a column of pixel value pairs representing the 
30 pixel values of the adjacent pixels of the two columns is formed 32. Next a pair 
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of columns of local mean values representing the mean values of pixels in an N 
pixel window for each of the adjacent columns of image data is formed 34. The 
local means |i „f (x,y,2^j) and |i„f (x+l,y,z,e^ are calculated using 



5 /^.^(x,y,z,,f) = 



N 



(N-1) 
2 

2^i'(x,y + n,z^^,) 

^_ -(N-l) 
2 



(15) 



(N-1) 
1 ^ 

>"r<(x + l,y,Zref) = T7 2 ^ ^ ' ^ ^' ^ref ) (16) 

N .(N-1) 



SJ (N-1) 
1^ 1 ^ 

~ >"test,(x,y,Ztest,) = Tf Zi'(^'y"*"^'2:,^t,) (17) 

IN .(N-l) 

ru 

where N is the window length. To determine if i*(x,y,Zre^ » iXx+l,y,Zrec), a mask, 
Py such as the mask 35 shown in FIG. 6, is centered at pixel iXx,y,z^f) and convolved 

f= (N-1) 

g with the image. Pixels in the first and last — ^ — rows of the image will not be 



used to determine Aa^ and Ab,^. 
15 Next, a test for similarity between bands in the local pixel regions 

is also performed. First a bias, Bj, is added to the pixel values in each of the local 
windows in the bands Zt^^i used to calculate the mean in Eq. (17) such that M^ref ^ 
Miesti- Next, a correlation is calculated 36 over the local window region (x,y-Hi) 
between each test band Zt^^ and the reference band x^^^ given by 



20 



Corr, = -j — " (18) 
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Next, a local difference metric M„f(x,y,z;j^f)is calculated that 
measures the similarity between local pixel regions. A difference metric based on 
the difference between the mean reduced values is given by 



M^f(x,y,z^f) = ^ 



(N-1) 



^{[/•(x,y + n,z^^)-//(x, y,z^f)]-[f(x + l,y + n,z^f)-//(x + l,y,z^f)]}^ 

(19) 



,, -(N-l) 
2 



If the calculated correlation, Corr^ > T^, where Tc is the correlation threshold, for a 
given test band (Zjesti), then an additional difference metric Mtesti(x>y»Ztesri) is 
calculated : 



^testi(^'y'^esti) = 



1 

N 



mi 

fr bias y ^ testi ) ■ ^testi ^testi >] - + 1 , y + n, z^^^ ) - ^tesii + ^ ' ^ref >]}^ 



(20) 



where ibiaXXjy+njZ^s^) represents the bias adjusted pixels over the local window 
region. Next, the average local difference metric 37 is calculated: 

Mref (x, y, z^^j. ) + 2 M,„„. (x, y, z,^,^ ) 
M(x,y,z) = (21) 

^ bandsC ^ 



where Nbandsc the number of test bands in which ConTj > T^. 

The local pixel regions are similar if M(x,y,z) < Tj^ , where Tj^ is 
the difference metric threshold. The optimal value for Tj^ will depend on the 
characteristics of the digital sensor 10. A maximum difference threshold, Ta , is 
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defined by determining the largest magnitude difference of A(x,y,z) that is 
possible from calibration differences alone. 

To determined the values of Aa^ and Ab^ in Eq. (7), two columns of 
pixel values i^^^Cn) and pixel values i^+iCn), where n is a counting index, are 
generated 38 for each row x, where only the k values of i(x,y,z^^ and i(x+l ,y,z„f) 
that satisfy the conditions M(x,y,z^f) < and \A{x,y,z^f)\ < are used. 

Initial estimates of the slope and offset are determined by 
performing a linear regression between i^(n) and ix+i(n) to determine the regression 
line 39 in FIG. 7. The initial estimate of the slope, Aa*^ , is calculated 40 by 



i x^i (n)i X (n) - X i x^i ^ x (n)) 



Aa' = 



Vn=l 



y 
J 



where k is the total number of elements in ix(n). The initial estimate of the offset, 
Ab'^ , is calculated 42 by 



k k 

Xi,(n)-Aa,Xi,,,(n) 

^l^. Jl^l n^l 

k 



The slope Aa^ and offset Ab^ for Eq. (7) are determined by 
performing a second linear regression between ij^(n) and ix+i(n) after the statistical 
outliers 43 in FIG 7 have been removed from the estimates of Aa',, and Ab*^. The 
standard error s^ of the linear regression is calculated 44. The statistical outliers 
43 will be defined as points lying outside a boundary 45 that is dependent on the 
standard error of estimate s^, given by 



where 



X|i.(n)-i»] 



k-2 



i^(n)= Aa,i,^,(n) + Ab^. 

Values of i(x,y,z„£) that satisfy the condition |i,(n) - i,(n)| < are 

determined 56, these values are not statistical outliers. The outlier threshold is 
proportional to s^ and is typically set equal to Ss^. Two new columns of pixel 
values, ijn) and its adjacent pixel ix+i(n) are generated 48 for each row x, where 
only the j < k. The slope Aa, and offset Ab^^ for Eq. (7) are now determined 60 by 



jZ - Ji.+,(n) i,(n)) 

n=l Vn=l ^ 



j J 

Ab^ =^ 



The final statistical tests performed 52 are to determine if the slope 
Aa^ is statistically different fi-om unity and the offset Ab^ is statistically different 
firom zero. These tests are performed to ensure that the difference in the response 
curves estimated for detectors d^ and d^+, are statistically different. If they are not 
statistically different, then using the estimates for Aa^ ^ 1 and Ab^ 9^ 0 may add 
streaking to the image rather than remove it, hence degrading the quality of the 
image rather than improving it. 
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A statistical hypothesis test is used to determine if the slope Aa^ is 
statistically different from unity. The t statistic is given by 



Aa.-l| 



where 



s = 



I 

I 



i Six+i(n)Six(n) 
Aa J 2 ix.. (n)ix (n) - r^^^^ 



j-2 




The t statistic is compared to the t distribution value t^ to 

2 

determine if Aa^ is statistically different from unity. If t^^^ < t^ then Aa,^ is not 

2 

Statistically different from unity hence a value of 1 is used 54 for Aa^ in Eq. (7). 
The value used for t ^ depends on the nimiber of sample points j as well as the 

2 

confidence level desired for the statistical test, which is given by 100(1 -a)%. For 
a 95% confidence and j > 50, t^ =1.96. 
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To determine if the offset Ab,^ is statistically different from zero, 
the t statistic is given by 



|AbJ 




Si 



If t^^,^ < t^ then Ab^ is not statistically different from zero hence a value of 0 is 

2 

used 56 for Ab^^ in Eq. (7). 

Finally, the pixels i(x+l,y,z^£) in column x are modified by Eq, (7) 
to remove the streaks 58. The procedure outlined above is repeated for the next 
column of image data. This process is continued until all columns of the image 
data have been processed in the reference band. This process is then repeated for 
each band of the spectrally transformed image. Once each band of the spectrally 
transformed image is streak-removed, the inverse spectral transformation 60 is 
applied 

where is the Nb^nd ^ ^bmd inverse transformation matrix, and the corrected 
digital image 24 is output. In the preferred embodiment for a three-band color 
image, the inverse spectral transform is: 

i(x,yA) - V{x,y^) -h 1.402/*(x,3;,3) 

iix,y,2) = V(x,y,l) - 0.34414r(jc, j;,2) - 0.7 1414/' (x,j;,3) 



/(x,>;,3) = i\x,y.\) + 1.772z'(;c,y,2) . 
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The invention has been described with reference to a preferred 
embodiment. However, it will be appreciated that variations and modifications 
can be effected by a person of ordinary skill in the art without departing fi-om the 
scope of the invention. 
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PARTS LIST 



2 streaks 

4 banding 

6 scene variation 

8 image artifact 

10 digital sensor 

12 digital image 

1 4 detector equalization 

1 6 equalized image 

1 8 streak removal operation 

20 corrected digital image 

22 image processing and enhancements 

24 final processed image 

28 transform multi-band data to spectrally advantageous space step 

30 selecting two adjacent columns of pixels step 

32 create two columns of adjacent pixel values step 

34 calculate local means step 

35 mask used for testing pixel relationship 

36 Calculate correlation between bands step 

37 calculate local difference metric step 

38 remove pixel values fi"om columns of pixel values that exceed thresholds 
step 

39 line fi-om linear regression 

40 determine initial estimate of slope step 

42 determine initial estimate of offset step 

43 statistical outliers 

44 calculate standard error of linear regression step 

45 statistical outlier boundary 

46 determine statistical outliers step 




-21- 



48 remove statistical outliers from columns of pixel values step 

50 determine new estimate of slope and offset step 

52 determine t statistics for slope and offset step 

54 set slope to unity if not statistically different from unity step 

56 set offset to zero if not statistically different from zero step 

58 remove streaking using slope and offset values step 
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